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DETAILED ACTION 
Remarks 

1 . In response to communications filed on February 21 , 2006, claim 12 has been 
cancelled; claims 1, and 16 have been amended, and new claims 20-22 have been 
added per applicant's request. Therefore, claims 1-11 and 13-22 are presently pending 
in the application. 

Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter, which the applicant regards as his invention. 

3. Claims 20-22 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

Claims 20 and 21 recites the limitation "The indexing system of claim 12". There 
is insufficient antecedent basis for these limitations in the claim because claim 12 is 
cancelled. Correction is required. 

Claim 22 is rejected under 35 U.S.C. 112, second paragraph because it is dependent 
on rejected independent claim 21. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C, 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
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the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-2, 7-8, 12, 16 and 19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Li et al. (U.S. Patent No. 6,397,181), in view of DwecketaL (U.S. 
Patent No. 6,970,870). 

As to claim 1 , Li et al. teaches an indexing system for tagging a media stream 
(See abstract; column 1, lines 32-37; column 4, lines 4-6, where "tagging" is read on 
"annotation") comprising: 

at least one input that provides information for defining at least one tag (See 
column 1 , lines 32-47); 

a tagging system for assigning the at least one tag to the media (See column 1, 
lines 32-37); and 

a collaborative tag handling system for dispatching the at least one tag to a 
plurality of individuals for review based on tag source (See column 4, lines 16-20). 

Li et al. does not teach wherein the at least one tag includes a label identifying a 
source of the at least one tag respective of another source providing another tan via 
another input, wherein the other tan is also assigned to the media the other tag having 
another label identifying the other source. 

Dweck et al. teaches systems and methods for facilitating access to documents 
via associated tags (See abstract), in which he teaches wherein the at least one tag 
includes a label identifying a source of the at least one tag respective of another source 
providing another tan via another input, wherein the other tan is also assigned to the 
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media the other tag having another label identifying the other source (See column 1 , 
lines 50-57; column 5, lines 40-63; column 6, lines 23-29). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. . to include wherein the 
at least one tag includes a label identifying a source of the at least one tag respective of 
another source providing another tan via another input, wherein the other tan is also 
assigned to the media the other tag having another label identifying the other source. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et al. , by the teachings of Dweck et al. 
because wherein the at least one tag includes a label identifying a source of the at least 
one tag respective of another source providing another tan via another input, wherein 
the other tan is also assigned to the media the other tag having another label identifying 
the other source would provide better information to the content reader in terms of the 
interest of that reader (See Dweck et al.. column 2, lines 1-9). 

As to claim 2, Li et al. as modified, teaches wherein at least one input comprises 
at least one speech input, and the tagging system includes a speech recognition system 
(See Li et al.. column 5, lines 19-47). 

As to claim 7, Li et al. as modified, teaches wherein the at least one tag includes 
a pointer for associating the at least one tag to a timeline of the media (See Li et al.. 
column 4, lines 56-64). 
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As to claim 8, Li et al. as modified, teaches further comprising a tag analysis 
system comparing the information from each of the at least one input to determine and 
correct inconsistencies therein (See Li et aL. column 5, lines 48-52; column 6, lines 10- 
20; column 7, lines 46-65). 

As to claim 12, Li et al. as modified, teaches wherein the at least one tag 
includes a label identifying a source of the at least one tag (See Li et al., column 10, 
lines 28-35). 

As to claim 16, Li et aL teaches an indexing system for tagging a media stream 
(See abstract; column 1, lines 32-37; column 4, lines 4-6, where "tagging" is read on 
"annotation") comprising: 

at least one input providing information to define at least one tag (See column 1 , 

lines 32-47); 

a tagging system for assigning the at least one tag to the media (See column 1 , 
lines 32-37); a tag database for storing the at least one tag and the media (See column 
1, lines 6-10, lines 32-37); 

a tag analysis system comparing the information from each of the at least one 
input to determine and correct inconsistencies therein (See column 5, lines 48-52; 
column 6, lines 10-20; column 7, lines 46-65); and 
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a retrieval system for searching the tag database by analyzing the tags and 
returning results (See column 4, lines 16-20). 

Li et al. does not teach wherein said tag analysis system is adapted to determine 
and correct inconsistent tans assigned to a segment of media by comparing 
inconsistent tans from different sources employing different inputs to supply their 
respective tags. 

Dweck et al. teaches systems and methods for facilitating access to documents 
via associated tags (See abstract), in which he teaches wherein the at least one tag 
includes a label identifying a source of the at least one tag respective of another source 
providing another tan via another input, wherein the other tan is also assigned to the 
media the other tag having another label identifying the other source (See column 1, 
lines 50-57; column 5, lines 40-63; column 6, lines 23-29). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. . to include wherein said 
tag analysis system is adapted to determine and correct inconsistent tans assigned to a 
segment of media by comparing inconsistent tans from different sources employing 
different inputs to supply their respective tags. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li eta!. , by the teachings of Dweck et al. 
because wherein said tag analysis system is adapted to determine and correct 
inconsistent tans assigned to a segment of media by comparing inconsistent tans from 
different sources employing different inputs to supply their respective tags would 
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provide better information to the content reader in terms of the interest of that reader 
(See Dweck et a!., column 2, lines 1-9). 

As to claim 19, Li et al. as modified, teaches wherein the retrieval system uses a 
probabilistic retrieval model (See Li et al.. column 5, lines 48-52; column 6, lines 10-20; 
column 7, lines 46-65). 

6. Claims 3-6, 11, 14-15 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Li et al. (U.S. Patent No. 6,397,181), in view of Dweck et al. (U.S. 
Patent No. 6,970,870), in further view of Bennett et al. (U.S. Patent No. 5,884,256). 

As to claim 3, Li et al. does not teach wherein the speech recognition system 
includes a translation component that translates multiple languages into a common 
language, and the common language is stored in the at least one tag. 

Bennett et al. teaches networked stenographic system with real-time speech to 
text conversion for down-line display and annotation (See abstract), in which he teaches 
wherein the speech recognition system includes a translation component that translates 
multiple languages into a common language, and the common language is stored in the 
at least one tag (See Figure 5b; column 16, lines 46-67; column 17, lines 1-3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. . to include wherein the 
speech recognition system includes a translation component that translates multiple 
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languages into a common language, and the common language is stored in the at least 
one tag. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et a!. , by the teachings of Bennett et al. 
because wherein the speech recognition system includes a translation component that 
translates multiple languages into a common language, and the common language is 
stored in the at least one tag would clearly improve the system for indexing and 
retrieving media content (See Li et a!. , column 1 , lines 23-29). 

As to claim 4, Li et al. as modified, teaches wherein the speech recognition 
system stores multiple languages within the at least one tag (See Bennett et al.. Figure 
5b; column 16, lines 46-67; column 17, lines 1-3). 

As to claim 5, Li et al. as modified, teaches further comprising tag information 
feedback to a user for editing, deleting, and adding the information in the at least one 
tag (See Bennett et al., column 20, lines 6-13; column 23, lines 55-62; column 28, lines 
45-55). 

As to claim 6, Li et al. as modified, teaches wherein the at least one tag is 
comprised of a plurality of fields, each of the fields storing information from the at least 
one input (See Bennett et al.. column 7, lines 56-59; column 13, lines 30-33). 
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As to claim 1 1 , Li et al. as modified, teaches wherein the at least one tag 
includes a label identifying a language of the at least one tag (See Bennett et aL. Figure 
5b; column 16, lines 46-67; column 17, lines 1-3). 

As to claim 14, Li et aL teaches wherein the at least one individual comprises an 
individual that provides the at least one input (See Li et al.. column 4, lines 16-20; also 
see Bennett et al.. column 7, lines 1-19), 

As to claim 15, Li et al. as modified, teaches wherein the tagging system includes 
an encryption mechanism to encrypt the at least one tag (See Bennett et al.. column 26, 
lines 39-45, lines 56-61 ). 

As to claim 17, Li et al. as modified, teaches wherein the retrieval system uses a 
Boolean retrieval model (See Bennett et al.. column 19, lines 43-49). 

7. Claim 9, is rejected under 35 U.S.C. 103(a) as being unpatentable over Li et al. 
(U.S. Patent No. 6,397,181), in view of Dweck et al. (U.S. Patent No. 6,970,870), in 
further view of Ebert (U.S. Patent Application Publication No. 2003/0144985). 

As to claim 9, Li et al. does not teach wherein the at least one input includes at 
least one sensor for creating an attribute in the tag. 



Application/Control Number: 10/718,471 Page 10 

Art Unit: 2164 

Ebert teaches bi-directional data flow in a real time tracking system (See 
abstract), in which he teaches wherein the at least one input includes at least one 
sensor for creating an attribute in the tag (See abstract; paragraph 008). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. . to include wherein the 
at least one input includes at least one sensor for creating an attribute in the tag. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et al. . by the teachings of Ebert because 
wherein the at least one input includes at least one sensor for creating an attribute in 
the tag would clearly improve the system for indexing and retrieving media content (See 
Li et aL . column 1 , lines 23-29). 

8. Claim 10, is rejected under 35 U.S.C. 103(a) as being unpatentable over Li et al. 
(U.S. Patent No. 6.397,181), in view of Dweck et al. (U.S. Patent No. 6,970,870), in 
further view of Jain et al. (U.S. Patent No. 6,463,444). 

As to claim 10, Li et al. does not teach wherein the at least one tag includes a 
confidence value associated with the attribute. 

Jain et al. teaches video cataloger system with extensibility (See abstract), in 
which he teaches wherein the at least one tag includes a confidence value associated 
with the attribute (See column 9, lines 18-22). 
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Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. , to include wherein the 
at least one tag includes a confidence value associated with the attribute. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et al. . by the teachings of Jain et aL 
because wherein the at least one tag includes a confidence value associated with the 
attribute would clearly improve the system for indexing and retrieving media content 
(See Li et al. . column 1, lines 23-29). 

9. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Li et aL 
(U.S. Patent No. 6,397,181), in view of Dweck et al. (U.S. Patent No. 6,970,870), in 
further view of Srivastava et al. (U.S. Patent No. 6,549,922). 

As to claim 1 3, Li et al. does not teach wherein the at least one tag includes an 
attribute for assigning a copyright designation therein. 

Srivastava et al. teaches a system for collecting, transforming and managing 
media metadata (See abstract), in which he teaches wherein the at least one tag 
includes an attribute for assigning a copyright designation therein (See column 2, lines 
28-40). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. . to include wherein the 
at least one tag includes an attribute for assigning a copyright designation therein. 
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It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et al. , by the teachings of Srivastava et al. 
because wherein the at least one tag includes an attribute for assigning a copyright 
designation therein would clearly improve the system for indexing and retrieving media 
content (See Li et al . column 1 , lines 23-29). 

10. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Li et al. 
(U.S. Patent No. 6,397,181), in view of Dweck et al. (U.S. Patent No. 6,970,870), in 
further view of Lui et al. (U.S. Patent Application Publication No. 2003/0105589). 

As to claim 18. Li et al. does not teach wherein the retrieval system uses a vector 
retrieval model. 

Lui et al. teaches a system for collecting, transforming and managing media 
metadata (See abstract), in which he teaches wherein the retrieval system uses a 
vector retrieval model (See paragraph 0067). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention was made to have modified Li et al. , to include wherein the 
retrieval system uses a vector retrieval model. 

It would have been obvious to a person having ordinary skill in the art at the time 
the invention was made to have modified Li et al. . by the teachings of Lui et al. because 
wherein the retrieval system uses a vector retrieval model would clearly improve the 
system for indexing and retrieving media content (See Li et al. . column 1, lines 23-29). 
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Response to Arguments 

1 1 . Applicant's arguments filed on February 21 , 2006, with respect to the rejected 
claims in view of the cited references have been considered but are moot in view of 
applicant's amended claims necessitate new ground(s) of rejection. 

Conclusion 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mellissa M. Chojnacki whose telephone number is (571) 
272-4076. The examiner can normally be reached on 9:00am-5:30pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Charles Rones can be reached on (571) 272-4085. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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SAM RIMELL 
PRIMARY EXAMINER 



